312 Amended Claims 
(with additions and deletions marked) 


Claim 1 57. (Amended) A system for automatically videoing the activiti e s movements of one or more 
participants or objects? as they move about within a pred e fin e d the entire performance area? 
of a sporting, theatre or concert event, during a predefin e d throughout the entire time 
duration of the event , comprising: 

a first set of two or mor e multiple stationary overhead cameras , not capable of pan, tilt 
or zoom movement, sufficient to form a contiguous field-of-view of said entire 
performance area, for generating a first video stream of images that together form a 
contiguous view of th e pr e defined area continuously throughout the predefined said 
entire time duration ; 

a first algorithm operated on a computer system exclusively and solely responsive to 
fee said first stream of video images for continuously and simultaneously analyzing 
the images from e ach first cam e ras all cameras in said first set of multiple stationary 
cameras in order to detect the presence of any one or more participants er objects each 
participant or object within each and every camera's view, to determine for each 
detected participant or object its relative centroid two-dimensional location centroid 
coordinates within that view, and to combine use this determined information from 
each and every all said first set camera cameras tfrte for updating a real-time tracking 
database of at least the ongoing centroid two-dimensional coordinate s centroid 
location of each one or more participants or obj e cts participant or object , relative to 
the said entire pr e defined performance area, where said real-time tracking database 
includes all current and past said centroid locations determined throughout said entire 
time of said event, and 

a second algorithm operated on a computer system exclusively and solely responsive 
to the said real-time tracking database for dynamically automatically and individually 
adjusting the current view of each one or mor e cameras camera in a second set of 
movable multiple stationary cameras, capable of pan, tilt and zoom movement distinct 
from the said first set of stationary cameras, wherein each movable said second set 
camera is automatically directed without operator intervention to maintain an 
independent view of one or more the participants or objects, where the said second set 
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of movable cameras outputs a second stream of video images for viewing and 
recording , and where fee wherein said second stream of video images is not used to 
either determine any participant's or object's c e ntroid two-dimensional coordinat es 
centroid locations or to otherwise update fee said real-time tracking database. 

Claim 1 58. (Amended) The system of claim 1 57 wherein the contiguous view field-of-view formed 
by fee said first set of stationary overhead cameras is substantially parallel to the ground 
surface within the predefin e d said entire performance area. 

Claim 1 59. (Amended) The system of claim 1 57 for further providing a three dimensional model of 
the activities movements of one or more participants or objects, further comprising: 

a third algorithm operated on a computer system responsive to fee said real-time 
tracking database and fee said first of and said second streams of video images for 
determining the ongoing relative three-dimensional coordinates of one or more 
specific, non-centroid locations on each participant or object and for updating fee said 
real-time tracking database to include the additional three-dimensional coordinates of 
all detected locations matched with the respective participants or objects. 

Claim 1 60. (Amended) The system of claim 1 59 further comprising: 

markers adhered onto one or more locations on each participant or object to be 
tracked, where fee said markers are detectable by fee said first or said second set of 
stationary cameras, and where fee said first or said third algorithms now determine the 
locations of th e adhered said markers and update fee said real-time tracking database 
with the related ongoing three-dimensional coordinates of each det e ct e d marker for 
forming the three dimensional model of each participant's activiti e s movements . 

Claim 161. (Amended) The system of claim 1 60 wherein fee said markers are substantially 
transparent to the participants, further comprising: 

said markers adhered onto participants that reflect, retroreflect or fluoresce primarily 
non-visible energy and are therefore substantially visibly transparent, and 

one or more energy sources emitting non-visible energy that is reflected or 
retroreflected off of fee sajd markers, or emitting energy that is fluoresced in the non- 
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visible spectrum by fee said markers and is detectable by fee said first or said second 
set of stationary cameras. 

Claim 1 62. (Amended) The system of claim 161 wherein the participants are additionally identified, 
further comprising: 

at least one uniquely encoded marker adhered onto an upper surface of each 
participant to be identified, and 

a forth algorithm operated on a computer system for locating and recognizing fee said 
encoded markers within fee said first stream of video images and for updating fee said 
real-time tracking database with each participant's identity matched to their 
coordinates. 

Claim 163. (Amended) The system of claim 162 wherein fee said uniquely encoded markers are 
substantially transparent to the participants, further comprising: 

said uniquely encoded markers that reflect, retroreflect or fluoresce primarily non- 
visible energy and are therefore substantially visibly transparent, and 

one or more energy sources emitting non-visible energy that is reflected or 
retroreflected off of fee sajd encoded markers, or emitting energy that is fluoresced in 
the non-visible spectrum by fee said encoded markers and is detectable by fee said 
first set of stationary overhead cameras. 

Claim 1 64. (Amended) The system of claim 1 57 wherein the participants are additionally identified, 
further comprising: 

at least one uniquely encoded marker adhered onto an upper surface of each 
participant to be identified, and 

a third algorithm operated on a computer system for locating and recognizing fee said 
encoded markers within fee sajd first stream of video images and for updating fee said 
real-time tracking database with each participant's identity matched to its their 
coordinates. 

Claim 1 65. (Amended) The system of claim 1 64 wherein fee sajd uniquely encoded markers are 
substantially transparent to the participants, further comprising: 
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said uniquely encoded markers that reflect, retroreflect or fluoresce primarily non- 
visible energy and are therefore substantially visibly transparent, and 

one or more energy sources emitting non-visible energy that is reflected or 
retroreflected off of the said markers, or emitting energy that is fluoresced in the non- 
visible spectrum by the said markers and is detectable by the said first set of stationary 
overhead cameras. 

Claim 1 66. (Amended) The system of claim 1 57 for videoing the activities movements of two or 

more participants, wherein the said second set of mov e able stationary camera s, capable of 
pan, tilt and zoom movement, comprises at least two cameras and wherein the said second 
set is additionally directed to automatically reassign any one or more of sajd second set 
cameras currently following any one or more participants to instead follow a different one 
or more participants based upon which camera views are currently blocked by one or more 
participants in front of another, or upon which camera views are best situated to capture the 
programmatically desired view of any given participant or game object. 

Claim 1 67. (Amended) A method for automatically videoing the activities movements of one or 

more participants or objects as they move about within a predefined the entire performance 
area of a sporting, theatre or concert event during a predefined throughout the entire time 
duration of the event , comprising the steps of: 

capturing a first stream of video images using a first set of two or more multiple 
stationary overhead cameras, not capable of pan, tilt or zoom movement, wh e rein th e 
combin e d view from all first cameras covers the sufficient to form a contiguous field- 
of-view of said entire predefined performance area, and where each sajd first set 
camera provides images continuously throughout the predefin e d said entire time 
duration ; 

simultaneously analyzing only the said first stream of video images coming from eaeh 
said first camera set of multiple stationary overhead cameras in order to continuously 
detect the presence of any one or more participants or objects within each and every 
camera's view, to determine each detected participant's or object's relative centroid 
two-dimensional location centroid coordinates within that view, and to combine use 
this determined information from e ach and every all said first set camera cameras 4nte 
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for updating a real-time tracking database of at least the ongoing centroid the two- 
dimensional coordinates centroid location of each one or mor e participants or objects 



participant or object relative to the sajd entire predefined performance are a, where 
said real-time tracking database includes all current and past said centroid locations 
determined throughout said entire time of said event ; 

using the said determined participant and object locations stored in said real-time 
tracking database to automatically and individually dir e ct adjust , without the aid of an 
operator, some combination of at lea s t the pan, tilt or zoom mov e ments of each 
camera in a the current view of each camera in a second set of one or more movable 
multiple stationary cameras , capable of pan, tilt and zoom movement, distinct from 
the said first set of stationary overhead cameras, and 

capturing a second stream of video images for viewing and recording using the from 
said second set of automatically movable multiple stationary cameras, wherein fee 
said second stream of video images create independent views of one or more of the 
participants or objects within the predefined said entire performance area and wh e re 
fee wherein said second stream of video images is not used to either determine any 
participant's or object's centroid two-dimensional coordinates centroid locations or to 
otherwise update fee said real-time tracking database. 


Claim 1 68. (Amended) The method of claim 1 67 wherein the contiguous field-of-view formed by fee 


view of the predefin e d ar e a is substantially parallel to the ground surface within fee said 
entire predefined performance area. 


Claim 1 69. (Amended) The method of claim 1 67 for further providing a three dimensional model of 


the activities movements of on e or mor e the participants or objects, comprising the 
additional step of: 

analyzing fee said real-time tracking database and both the said first and said second 
streams of video images to determine the ongoing relative three-dimensional 
coordinates of one or more specific, non-centroid locations on each participant or 
object and for updating fee said real-time tracking database to include the additional 



said first set of stationary overhead cameras is arranged 


combined, contiguous 
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three-dimensional coordinates of all detected locations matched with the respective 
participants or objects . 

Claim 1 70. (Amended) The method of claim 1 69 further comprising the steps of: 

adhering markers onto the one or more locations on each participant or object to be 
tracked; 

detecting the sajd markers using computer based image analysis of the said first or 
said second streams of video in order to determine the ongoing relative three- 
dimensional coordinates of each marker, and 

updating fee said real-time tracking database to indicate the ongoing relative three- 
dimensional coordinates of fee said d e t e ct e d markers matched with the respective 
participants or objects. 

Claim 171. (Amended) The method of claim 1 70 wherein fee said markers are substantially 
transparent to the participants, further comprising the steps of: 

using sajd markers that reflect, retroreflect or fluoresce primarily non-visible energy 
and are therefore substantially visibly transparent, and 

using one or more energy sources to emit non-visible energy throughout fee said 
predefined entire performance area, to be reflected or retroreflected off of fee said 
markers, or emitting energy that is fluoresced in the non-visible spectrum by fee said 
markers, where the non-visible energy is detectable by fee sajd first or sajd second set 
of stationary cameras. 

Claim 1 72. (Amended) The method of claim 1 7 1 for additionally identifying wherein the participants 
are additionally identified , further comprising the steps of: 

placing at least one uniquely encoded marker onto a-tep an upp er surface of each 
participant to be identified; 

detecting and recognizing each encoded marker using computer based image analysis 
of fee sajd first stream of video images , and 
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updating the said real-time tracking database to indicate the identity of each 
participant matched to their coordinates. 

Claim 1 73 . (Amended) The method of claim 1 72 wherein the uniquely encoded markers are 
substantially transparent to the participants, further comprising the steps of: 

using said uniquely encoded markers that reflect, retroreflect or fluoresce primarily 
non-visible energy and are therefore substantially visibly transparent, and 

using one or more energy sources to emit non-visible energy throughout the 
pr e defined said entire performance area, to be reflected or retroreflected off of the said 
encoded markers, or emitting energy that is fluoresced in the non-visible spectrum by 
the said encoded markers, where the non-visible energy is detectable by the said first 
set of stationary overhead cameras. 

Claim 1 74. (Amended) The method of claim 1 67 for additionally identifying wherein the participants 
are additionally identified , further comprising the steps of: 

placing at least one uniquely encoded marker onto a top an upp er surface of each 
participant to be identified; 

detecting and recognizing each said encoded marker using computer based image 
analysis of the said first stream of video images , and 

updating fee said real-time tracking database to indicate the identity of each 
participant matched to their coordinates. 

Claim 1 75. (Amended) The method of claim 1 74 wherein the said uniquely encoded markers are 
substantially transparent to the participants, further comprising the steps of: 

using uniquely encoded markers that reflect, retroreflect or fluoresce primarily non- 
visible energy and are therefore substantially visibly transparent, and 

using one or more energy sources to emit non-visible energy throughout the 
predefin e d said entire performance area, to be reflected or retroreflected off of the said 
encoded markers, or emitting energy that is fluoresced in the non-visible spectrum by 
fee said encoded markers, where the non-visible energy is detectable by fee said first 
set of stationary overhead cameras. 
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Claim 1 76. (Amended) The method of claim 1 67 for videoing the activities movements of two or 
more participants from optimal viewpoints, further comprising the steps of: 

using two or more cameras in the said second set of movable stationary cameras, and 

during the step of individually dir e cting at least adjusting the pan, tilt or zoom 
movements of each camera in the said second set of stationary cameras , capable of 
pan, tilt and zoom movement, dynamically considering the location of each 
participant or object with respect to the view of each said second set camera and 
automatically reassigning any one or more said second set cameras currently 
following any one or more participants or objects to instead follow a different one or 
more participants or objects based upon which camera views are best situated to 
capture the programmatically desired view of any given participant or game object. 
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